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ABSTRACT 

Indices and manifestations of quality in 
undergraduate education arc considered and a four-part framework is 
developed. Context indices represent institutional characteristics 
that regain relatively stable over time (e.g., expenditures per 
stude. aui size of student body), while input indices reflect 
characteristics of entering students (e.g., ability and aspirations). 
Manifestations of quality are evidenced by involvement and outcome 
indices; the former characterize interactions between and among 
students and faculty, such as satisfaction and frequency of contact, 
and the latter reflect intended products or unintended effects 
associated with college attendance, such as persistence, academic 
achievement, and alumni attainments. Commonly used context indicators 
of quality include size (number of undergraduate students), clarity 
and consistency of institutional purpose, student living 
environments, salaries, and decision-making strategies. The fo^owing 
input indices have been used to indicate quality: student ability, 
biographical characteristics of students, and nonintellective 
characteristics. Commonly used involvement indices have been 
instructional activities and informal student teacher interaction. 
The most often used outcome indices as manifestations of quality have 
included persistence, student achievement, intellectual and 
social/emotional development of students, and alumni achievements. 
Both quantitative and qualitative methodological approaches to 
quality assessment and societal trends influencing the need for 
quality indicators are briefly reviewed. These trends include 
declining enrollments and financial constraints, A bibliography is 
appended. (SW) 
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Foreword 



Defining and measuring qualitv in gener al and the quahtv of student expe- 
rience in parhculai has been elusive This is true in pait because quahtv is a 
reiameterm Something is perceived to be of highqualitv if i< meetsccrtam 
idealistic standards, or if it fulfills better thar something else ceitain speu- 
hed needs If evervone had the same perceptions, definingqualitv would be 
easv But since standards and needs v arv according to the indiv idual and t he 
situation, the definition of quahtv necessanlv vanes 

Because the concept of quahtv is relative, there is aiso a problem m 
quantifvmg the concept Mot onlv is the process of precise!) measuring 
quahtv hindered bv a lack of a universal accepted definition, it is also 
hindered because the whole is usuallv differ ent from the sum of the indiv id* 
ual parts That is, an institution mav appear to have onlv average parts 
(facultv. students, academic environment, etc ) but the end product (re- 
starch, academic and career achievements) mi\ be considered of high 
quahtv or converselv 

In this monograph, Geoi go D Kuh, associate professor, School of Loca- 
tion. Indiana Lniversitv, has helped to develop gi eater clantv in defining 
qualitv of student exper lence bx 5 nu\ vmg and rev revs mg specific indi, es 
ot quahtv In doiniz this, he has anaiv/ed the literature that addr es«>es three 
important areas ()) the multiple properties ol quihtv, (2) the utihtv ot 
different methodologK al approaches to quahtv assessment, and (3) the 
opinion and empirical research about quahtv in the undergraduate expe- 
rience Through this anaU ms iu« has developed afoui-part framework that 
will greativ arcl institutions in then evaluation ol the undttgiaJuate 
experience 

Jonathan D, Fife 

Director 

eric* Clear inghoir.e on Higher FduwUion 
The George Washington I niversitv 



Overview 



At vanous times during the past 20 years, different themes have influenced 
policies and piactices in institutions of higher education. Excellence in the 
early 1960s, access in the late 1960s, and egalitananism in the 1970s were 
issues that challerged administrators and faculty alike One of the salient 
themes of the 1980s promises to be quality 

Instead of steady and, at times, seemingly exponential expansion, col- 
leges and universities have been preparing for fewer students with more 
diverse learning abilities and educational goals. Concurrently, federal and 
state agencies have reduced financial support as a result of the sluggish 
economv, and state boards of higher education have become more involved 
in matters of curriculum. In response, institutions of higher education have 
begun to develop self-regulatory procedures to monitor the 'quality" of the 
educational experience, particularly at the undergraduate level Theretore, 
the identification of appropriate indices of quality is of current interest to 
manv 

Indicators such as institutional resources or student ability have been 
used most often to estimate quality. To be valid, indicators should predict 
fnanifestations or after-the-fact attributes of quality such as achievements 
resulting from a college education or the degree and kind of effort students 
invest in the learning orocess Although quality is often addressed in the 
literature, few detailed discussions of what connotes quality in the under- 
graduate experience have appeared Most observers have agreed that q aal- 
itv is a multidimensional concept that eludes a succinct, operational defini- 
tion But to assess quahtv , the properties of the concept require some level of 
description 

Most approaches to assessing quality m the undergraduate experience 
have been quantitative in nature, using scores on entrance examinations 
(student abiht\), facultv salaries, library holdings, and so on. Qualitative 
approaches represent an equally valid paradigm for assessing quality ana 
extcnsivelv use inquiry methods common to case studies, such as interv iews 
and observations Because quality is a multidimensional property . an ec Icc- 
Uc or holistic perspective on estimating quality that encompasses elements 
of both quantitative and qualitative approaches was considered valuable m 
analyzing vanous indices of quality previously reported in the literature 

To organize the discuss^ <J quality indicators and manifestations, a 
tour-pan framework was developed Context indices represent institutional 
c harac tcnstics that remain relativ ely stable o\ er time, such as expendit ui es 
per student and size of student bedv /wpwf indices reflect characteristics of 
entering students, such as ability and aspirations Manifestations of quality 
arc evidenced bv involvement and outcome indices, the former characterize 
interactions between and among students and faculty, such as satisfaction 
and fi equencv of contact, and the latter reflect intended products or unin- 
tended effects associated with college attendance, such as persistence, aca- 
demic achievement, and alumni attainments 

Common!* used context indicators of quality include size (number of 
undergraduate students), clantv and consistency of institutional purpose, 
organizational processes such as decision making strategies and grading 
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practices as well as informal systemic properties such as faculty norms and 
morale, financial resources such aj salaries and library collections; and 
student living environments. Four context indices seem particularly useful 
in estimating quality: size, purpose, student living environments, and infor- 
mal organizational properties. 

The following input indices have been used to indicate quality student 
ability, biographical characteristics of students, and nonintellective charac- 
teristics, such as aspirations and interests In general, input indices have not 
been particularly useful in predicting quality. 

As manifestations of quality, commonly used involvement indices have 
been instructional activities provided by faculty, informal interaction 
between students and faculty, and the degree and kind of effort both 
students and faculty invest in their respective roles. Involvement indices 
make upone of the most important and perhaps accurate ways of assessing 
quality and deserve further attention by assessors of quality. 

The most often used outcome indices as manifestations of quality hav^ 
included persistence, student achievement (usually measured by Graduate 
Record Examination scores), intellectual and social/emotional develop- 
ment of students, and alumni achievements, such as income and commun- 
ity service. For the most part, outcome indices have net reflected value- 
added increments in terms of student achievement. Alumni manifestations 
have been underemphasized but represent perhaps the most powerful -vi- 
dence of qu*ality in the undergraduate experience 

Based on a synthesis of the findings from this framework, the following 
conclusions seem warranted 

1 Certain conditions contribute to a higher quality undergraduate expe- 
rience For example, quality appears to be mediated bv the size of the 
institution or the living-learning unit and bv the involvement on the part of 
students and faculty, nother mediating variable is continuity, the degree to 
which dramatis personae remain relatively constant over a relativ ely long 
period of time. Continuity contibutes to generat: /ity, the capaci!> of those 
frequenting the environment to be supportive, caring, and shanng of their 
expenences with one another. Quality is also enhanced by the degree anc 
kind of energy students invest in their learning and social activities. Faculty 
also influence quality through the selection of instructional approaches 
Most important, quality is a function of a clear, coherent institutional pur- 
pose that lends Jirection to student and faculty efforts toward acquiring an 
integrated system of knowledge, values, and behaviors 

2. When one or more of these conditions ts absent, quality is less hkelxto 
be evident, 

3 Quality is probably beyond the direct influence of only a few institu- 
tional agents such as the president or key faculty; for institutional quality to 
be evident, the commitment and active involvement of administrators, 
faculty, students, and others are required 

4 Both qualitative and quantitative assessment methods must be used in 
concert to accurately estimate quahtv 
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The Meaning and Measurement of Quality 



Although qualit\ in Amcncan higher education has been an enduring ion- 
eern for over 200 vears (Stauffer 1981), the correct level of interest in the 
quality of practices and procedures in institutions of higher education ma\ 
be greater than ever before In 1980, for example the two largest higher 
education associations used "quality" as the theme of their respective con- 
ventions (Benezet 1981), and noted spokespersons such as Ernest Boyer 
(Bonham 1 978), Harold Hodgkmson (1981), and Shirlev Hufstedler (Connell 
1980) have identified qualitv as an important matter for institutions of 
higher education in the decade ahead. 

Quality is irrevocably related to higher edu< ation enterprise 

Quality is inextricably ncdtosuch issue* as equality of access and choice, 
postbaccalaureate employment and the volue of a college degree, curricu- 
lum structure, and student development and outcomes Only by under- 
standing how quality has been assessed can we know how and m what 
contexts it should be measured and which interventions should \teld 
improvement (Lawrence and Green 1980, p 3) 

Various indices can be used to estimate the quality of the undergraduate 
expenence in American higher education This report focuses on the wavs in 
which the concepts undergirdmg qualitv ratings are defined and assessed, 
particularly emphasizing qualitv as experienced bv under giaduate stu- 
dents 

The Case 'and Need) for Quality 

Concern for qualitv is not unusual in times of diminishing financial re- 
sources. After decades of expansion, the American svstem of higher educa- 
tion will likelv have to endure a penod of maintenance level economic 
support As pressures to economize mount during this penod, institutional 
decisions are likelv to be influenced b> the politics of survival Therefore, 
qualitv assessment- mav be used to help determine which institutional 
programs and services are to be r etained and which curtailed or terminated 
(Kuh 1979; Straumanis 1981). 

At least four societal trends and their interactions have underscored the 
importance of qualitv. ( 1 ) declining enrollments, (2) changing student char- 
acteristics, (3) changing societal expectations lor higher education, and (4) 
national and local economies 

Declining enrollment*. The svstem of Amer ican higher educ ation is about to 
expenem e t he leading edge ol the "babv bust" (Weather sbv 1 979). i t J evs ei 
college students of the traditional age Prognosticators disagree, however, 
as to 'he impact of fewer 1 8- v ear-old freshmen For example, Fioomkin and 
Dresc h ( 1 974) pr edict ed a 25 percent decline m enrollments fr om 1 975 levels 
bv 1985 Late?, Oossland (1980) forecast a 15 percent decrease between 
1982 and 1995 A more optimistic prediction is an increase in postsecondar \ 
enrollment to unprecedented levels bv 1990, about 3 5 percent higher than 
in 1980 (Frames 1980) 
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The prediction of declining enrollments coupled with other factors suth 
as faltering local economies (those linked with the automobile industry, for 
example) have forced legislators to reduce funding for state-supponed 
services, including colleges and universities In response, hipher education 
lobbv ists have argued that institutions can increase the quality of delivered 
services bv maintaining or slightly increasing support during a period u, hen 
fewer students must be accommodated (Weathersbv 1979) Smaller classes 
and freer access to libraries and other materials and activities could stimu- 
late both students and faculty to higher levels of achievement 

As enrollments declint, the competition for new students will increas- 
ingly force institutions to make difficult but 'mportant decisions For exam- 
ple, some institutions may lower entrance standards toadmit the number of 
st udents necessary to remain open, wnh educational quality suffering as the 
i esult. Institutions that can successfully identify, document, and articulate 
what makes their respec ive college or university a "better" educational 
environment may have an advantage in attracting students and in increas- 
ing cr maintaining "quality " 

Changing student characteristics. Increasing proportions of undergraduate 
students are pursuing major fields with applied or vocational emphases 
such as business and computer science (Astin, King, and Richardson 1 979) 
Increasing numbers of older students with different learning stvles and 
expectations for college are populating campuses (Chickenng nd Havig- 
hurst 1 98 1 ; Cross 1 976) At the same time, prospective students ot traditional 
college age appear less academically able as evidenced by declining scores 
on entrance examinations nnd inadequate reading and study skills Some 
observes have suggested that .he influx of "new" students with nontradi- 
tional characteristics, a product J the egalitarian movement, has threat- 
ened the le\ el of quality in American higher education (Cross 1 972; Mavhew 
197'; Meyerson 1975) At the least, traditional evaluative criteria for quality 
general education curricula will be less useful and perhaps less accurate 
when applied to students with nontraditional characteristics (see Gaff 1 980) 

Changing societal expectations. Expectations that educational institutions 
can alleviate society's problems such as racism, unemployment, and infla- 
tion have remained perhaps unrealistically high, and policy makers may 
have finally recognized that schools cannot sofve society's ills. Employers 
may no longer be satisfied with a credential such as a diploma but rather will 
expect other evidence of accountability or quality control (Drucker 1981) 
For example, the increased demand for better pupil performance in elemen- 
tary and secondary school systems may force some pos-tsecondary inst\ u- 
tions to describe their purposes more specifically and to develop devices to 
assess how well they have achieved their objectives (see, for example Wise 
1979). v ' 

In institutions of higher education, accreditation reviews are thought lo 
adequately monitor quality (Harcleroad and Dickey 1975; Thrash 1979, 
Young 1 976). The influence of accreditation on institutional functioning has 
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been questioned however (Bene/et 1981), oarticulailv concerning the 
degree to wh.ch students are receiving adequate and accurate information 
(Levne 198C) 

National and local economies. Declining enrollments, students' changing 
characteristics, and societv's changing expectations are all influenced to 
v arvmg degrees— and not necessanlv in the same direcfon— bv the state of 
national and local economies. On the one hrmd, if the gross national product 
increased substantially , less attention would perhaps be given to ascertain- 
ing whether college graduate^ can indeed perform as promised because the 
tolerance for error is , r C alei in an expanding market On the other hand, 
economic downturns traditionally have been iinked with increasing enroll- 
ment Recent evidence suggests that enrollments mav indeed be increasing 
at preseri, postponing the predicted decline in numbers of students (Maga 
rell 1981) and therefore the increased merest in qualitv resulting from 
fewer students 



The Meaning of Quality 

Quality is judged even da\ in the comparison of institutions (Astm 1980a, 
Jenny 1979; Young 1976). With few exceptions however, (Heath 1968, for 
example), the qualitv of the student experience a, such is not treated in an\ 
depth or with anv detail in the literature At least two reason lor this 
omission are possible 

1 Few categories of events common to institutions of higher education 
are evaluated bv and reported in the literature from the undergraduate 
student's perspective The evaluation of instruction is an obvious exception 
although tacultv question the accuracv' and validit\ of this perspective 
(Blackburn et al 1980, Reed 1981). 

2 Estimates of the qualitv of the undergraduate student experience ha\ e 
gencrallv relied on surrogate or proxv indicators thought to predict mani- 
festations of qualitv That is certain valued variables or characteristics 
(indicators) have been identified, and the degree to which the charai tensta 
is exhibited bv students or institutions has served as an approximation of the 
quality of the educational experience Manifestations or after-the-fact 
attributes of qualitv, such as a high degi ee of interaction between students 
and faculty outside class, have received less attention m the literature Tube 
valid and useful, indicators must be empirically related to manifestations of 
quality (Straumanis 1981) 

For the most part, the information considered in the following pages is 
based on applicable surrogate indicators of institutional quahty rathe! than 
students' manifestations of quality Where appropriate, inferences about 
the quality of the student experience are made from the surrogate indices 
The terms "index" and "indices" are used in a generic sense and embrace 
both indicators and manifestations of qualitv 

Guiding assumptions. Two a prion assumptions concerning qualitv guide 
the search for the meaning of qualitv in the undergraduate experience 



ERIC 



Indiaes of Quality ■ 5 



1 O 



ERIC 



1 Thequalitv of students' experience is related to a vanetv of factors and 
not the extent to which one ji two variables (such as stude.it abihtv or 
expenditures pet student) ate present (Bever and Snippet |s>74, Oiseamp 
1978. Pace 1979,Palo!a !976,Solmon 1981 , Star k and Lowther 1980. Stum- 
manis 198!) 

2 Qualm is a function of purpose in that the relative value o! a student's 
experience is related to various factors such as the student s expectations 
lor college, the institution's mission, and the behavior of fac ultv and signifi- 
cant others m the institution (Ha: shman l979,Kccton 1974) 

One urn to see how difficult fquahtx j is to wasp is huonsidet what might 
he iol7nfrn^l\ agreed to as the ten principal "indicator % of anal 
m \Vecu\ihst 4,000 different acud*>mw courses, thirty kinds of insti- 
tutional fat ilih(i\ forty student services, the Inn kground of the fat ult\ 
members, the nhnbers (even km V) of hooks in the library; the profes- 
sional pav scale, the charm ter of the institution's neighbors, the SM/\ of 
as students, the size an^wealth of its alumni body, and its income perl II 
indent, and we still do n\>t know whether the institution is a good one ot 
not I \ en if we know theh our ses were all taught splendidh, the facilities 
u t rein superior condition, the student services tailored to the students' 
needs, and soon, we still have not established the institution as one of 
superior qualm in die eves of all on whom it may depend for its \ 7- 
httnv Parents, students, alumni of various sorts, faculty members here, 
famlh members elsewhere, legislators, foundation officials, the Offue 
f or c I Rights, the pin in a law suit, the poln eman who bundles rush 
hour irutfu—all will have different views And even when two institu 
nuns haw alt the listed things in common, their evaluate)? s rna\ rate one 
msiituium bt tter than the other because the malt h between th elements 
aiuh'< professed purposes is t lear and the c or responding matt h of the 
st i ot id tn smut ion is fault \ (hurniss IV7H, /> 21) 

The salience ol the institution's put pose is important {Keeton 1971) *\n 
institution's k ar poses follow horn philosophical guideposts suggested h\ \u 
commitment tu u pai tu ular religious, ideological, or c ultui al perspective 

i ai king an agreement on purpose, there tannoi be dear criteria as to 
m hetht r tin- outt tunes of the program are good tn the ways intended 
(>n en an agreement on purpose, there may still be disagrecmertt as tntlv 
best wax s to pursue fuualtt\ / but at least the merits of the me*hod* u//; 
b t argued in the light of ohjei lives thatare supposed to be sen ed (Keeton 
W4. p n 

Law renc e and Green { i ^80) suggested t hat qualit v should be i efer em ed 
l.» stated departmental or institutional goals and objectives (see also Suit! 
1^8 1) While such statements can serve to cianfv central purposes of a 
program or institution, exc lussve attention togoal*- md objectives can divei t 
attention from the puness through which students learn and develop and 
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locus onl\ on outcomes ox lasting manifestations ol the experience In 
addition, assessing the degree to which goals an J objectives are attained 
genet all\ results in the use o! quantitative indites ol qualm While such 
indices are not to be overlooked, qualitative approaches mav anobc helpful 
in estimating qualitv (Stark and Lowther 1980) 

Adequacy, excellence, and quality. The concepts of qualitv adequacy, and 
exc elleuce discussed in the literatui e hav e similar connotations, but thev ai e 
not interchangeable Therefore, unless these terms are carefullv dehned, 
considerable confusion can res It in the search lor uselul indices of qualitv 
These three concepts lequ re comparison with some predetermined 
criteria to assess tr e attainment of a part icular purpose or 1 equirement The 
shades ol distinction between these terms are associated with the degrees to 
which ment and worth are important considerations in the respective com- 
parison Lincoln and Cuba (1979) have argued that merit represents an 
intrinsic, context-tree value, "independent of am requirements ol applica 
bihtv oi use" (p 1) For example, ceitam scientilic discoveries mav be 
meritorious because scientists appreciate an important addition to knowl- 
edge lor its own sake If a discover \ were without theoi etical signilu ance 
(without mei it) but had utilitv in a practical context, the disc overs would be 
worthwhile In other words, worth is an extrinsic, contcxt-specitic value 
{See Lincoln and Guba for a thorough disc ussion ol the distinction between 
merit and worth ) 

/U/et/iwcvsuggeMs a level of sullic icncv foi certain peisons in a specilic 
i ontext or setting and embodies the elements ol woi th but not nei ess.u iU ol 
merit (McCarthv N81, Wise 1976) hxcelloue intimates an absolutelv 
superior standard of attan ment. standards that are not bound bv lime oi 
lOPtext and aiegood m their ow n i i^ht, thereloi e. thee riteiia for merU ate 
met but not mvessanlv those tor worth The luiu ept of quahts embodies 
elements ot both merit and worth, that is, a high {bin not ncccssaiiK 
superior) level of attainment is lequired that also has utilitv oi worth tor 
those vvho take part in the c \perience 

Methodological Approaches to Quality Assessment 

In general, met hodologicil approaches to qualitv assessment can be drvided 
into two categories quantitative and qualitative Various tei rns are used to 
describe these approaches For example, quantitative qualitv assessments 
are often grounded in the tiadition of the agricul.ural-botanv and p^vcho 
metric paradigms (Sherman 1981) and relv almost exciusivelv on' opera- 
tionaliv" defined {Astm 1980a) and "objective" measures ( Astm and Solmon 
1^79} B\ corttast, qualitative inquirv is sometimes referred to as naturalis- 
tic or ethonogiaphic and Upteailv embraces a vanetv mine subjective 
assessment tools (see Guba 19^8, Wilson 1977, and Wo!! 1^79 lor detailed 
discussions of naturalistic inquirv methods) In practice, etforts to assess 
qualitv within an institution usually incorporate elements Irom both para- 
digms Nevertheless, these two approaches are separated here lor two 
reasons First, adhererue to one approach to the exclusion of the othei 
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substantially influences what is assessed and the assessment strategies 
employed, and second, quantitative methods have dominated quality 
assessments for a considerable p. »od of time, and it therefore seems 
appropriate to illuminate the advantages, limitations, and relative utihtv of 
various approaches (Stark and Lowther 1980) Atnird approach, the holistic 
perspective, combines elements of the quantitative and qualitative methods 

Quantitative methods. Attempts to estimate the quality of undergraduate 
student experiences using quantitative methods tend to focus on factor* 
related to the institution about which objective data exist or can be 
gathered. Objective, standardized measures are preferred because- (1) thev 
permit comparisons within and across institutions over time, (2) thev art- 
amenable to tr admonal computer-assisted analytic procedures, and (3) thev 
are consistent with the dominant psychometric paradigm of the social 
sciences as well as the values of many institutional reseachers Although 
multivariate procedures can assimilate more than one set of measures at a 
time, quantitative approaches tend to emphasize umdimensional perspec- 
tives, resulting almost exclusively m indicators rather than manifestations 
of quahtv Examples of indices often used in quantitative assessments of 
qualitv ar e aptitude or achiev ement scores in exam i hat ions like the Scholas 
tic Aptitude Tests, rank in high school class, expenditures per student, 
proportion of lacuhv with doctorates, faculty salaries, libraiv collections, 
and number ot fellowships awarded to seniors 

Qualitative approaches. If t l t "quahtv' of an expenent e is to be estimated, 
those involved m the process must be afforded ' an opportune to describe 
their experience, assrss the quahtv thereof, and comment on the meaning of 
those experiences for them ' (Wolf 1979, p 1) The qualitative assessment 
paradigm emphasizes manifestations of quality (e g , student involvement ot 
student -institution interactions and outcomes) and rc< ogni/es the tmpoi- 
tanee and validitv of multiple interpretations of rcahtv 

In qualitative qualitv assessments, objectivity is emphasized less and 
case studv methods such as interviews, observations, and anab ses of exist 
mg documents are used extensivelv (Sherman 1981) Naturalistic or ethno- 
graphic methods are generally considered less reliable when used to eval- 
uate differences between institutions or even within institutions This is not 
to sa* that qualitative methods cannot be used to compare institutions h>i 
example, consider the ;ic h descriptive comparisons between the Umversitv 
of Massachusetts Boston College, and San Francisco State College made bv 
Ri esrnan and Jencks ( 1^62) However, ethnographic approac hes are some- 
times challenged on the grounds that institutional differences in purposes, 
students, and resources are so great that evaluative comparisons are mean 
ingless (see Campbell, Converse, and Rogers 1976 foi a discussion o! 
the issues associated with descriptive and evaluative uses of qualitv 
assessments) 

Sources of mf or tna'ion av ailable for qualitative assessments of the qual- 
itv of the student experience include student reports of satisfaction with 
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vinous aspects of the institution. facultv reports of satisfaction with student 
perfoi mance, Observations oi students' behavior m class and out of class 
vis-a-visthe institutional mission and purpose, records of students' partici- 
pation in extrjc urr lcular ac tivities (see Brow 11 and Citnn 1 97*7), and t ecords 
iA Lbrarv use 

The holistic perspective. Qualit v in higher education is not a umdimeriMonal 
concept(Kuh 1980a, Lawrence and Green 1930, Palola 1976, Webster 1979} 
Therefore, exclusively using either a qualitative or quantitative approach to 
a c sess qualitv in the undergraduate experience will hkelv overlook impor- 
tant elements in the experience that could markedlv influence conclusions 
about quality and, perhaps more tmpo r tant, what can be done to improve 
the present level of quahtv (Astin 1980a) A holistic, eclectic perspective of 
qualitv assessment recognizes the validity and importance as well as 'be 
limitations of contrasting mquirv methods and the different kmds and 
sources of information tvpicalh tons'dered importani in the quantitative 
*ti qua! fahve paradigms (Staik and Lovvther 1980) In holistic qualitv 
assessments, the methods used to gather data are dictated bv students' 
cha* acteristKs, the institution's mission, and the purposes of the qualitv 
assessment I suallv more than oi.e form of data gathering is required to 
illuminate the various aspects of the students' experience (see Par let t and 
H tmiitoi! 1 '^76 foi -a detailed discussion of holutu "illuminative "sti ategies) 
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Several conceptual frameworks describe the v?"ious elements contributing 
to institutional quality Most of them have resulted from essentially unidi- 
mensional assessments reiving extensively on quantitative indicators such 
as student ability or library resources (see Lawrence and Green 1980 for a 
detailed summary of these approaches) However, multiple dimensions of 
an experience must be considered to estimate the degree to which qualitv is 
present in the undergraduate vears (Epstein and McPartland 1976, Kuh 
1980a, Palola i 976), 

Astin (1977: 1980a) has described an input-environment-output model, 
perhaps the most popular multidimensional approach to assessing qualitv 
Input represents what st udents bring wit h them to college (ability, interests, 
etc.), outcomes are measures of cognitive and affective changes associated 
with college attendance; and environment includes both interactions 
between students and others (faculty peers, etc ) and actual institutional 
resources such as librarv holdings, expenditures per student, and so forth 
Student interaction or involvement and institutional resources — Astins 
"environment"— make conceptually distinct contributions to qualitv The 
former are manifestations of student effort, the latter are made up of 
institutional indicators Therefore, these two sets of factors have been 
separated in this report to more clearlv describe the elements that conti ib- 
ute to qualitv in the undergraduate experience The four structual com- 
ponents of a popular evaluation model (StufHebeum et al 1971) have been 
redefined to enable a comprehensive anal v sis of the factors related to 
quality m the under graduate experience The result is an organizational 
framework with four dusters of variables context, input, ttixolvenwnt, and 
outcome 

Context inJic.es of qualitv are those characteristics of an institution's 
environment that are relative! \ stable over time, such as expenditures per 
student, size of student bodv, proportion of faculty with doctorate, and w> 
on These indicators have been relattvelv easv to produce, usuallv bv ti ad i 
tional quantitative methods Context variables mav interact with as vveH as 
mediate input and involvement variables to subsequentlv ml luetic, c the 
behavior of students and others in the institution 

Input indices are those charactensticsof entering students sue h as intel- 
lectual abilitv. interests, aspirations, and biographic^ characteristics (e# 
si/e of high school graduating class, sex) Input variables interact with and 
often mediate involvement variables and subsequentlv influence the hj 
hav lor of students and other s in the institution Like context variables, most 
input variables serve a*> indicators of qualitv and have been assessed using 
traditional quantitative methods 

Involvement indices are those inter jcuons (manifestations) that c har ac 
ter i/e the envn onment in which students live and lea» n, such as the amount, 
tvpe, and opportunity for informal interaction between students and 
facultv, students' satisfaction with the institution, and students' effort 
invested in c utricular and tocurncular activities These indices tend to be 
more subjective in nature that the other variables and often must bt 
assessed bv qualitative methods 
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Outcome indices arc those intended products or unintended effects 
(manifestations) associated with college attendance such as retention rates 
achievement levels (eg, Graduate Record Examination scores, postgrad- 
uate fellowships), measures of student development (cognitive, affective, 
and psvehomotor), and alumni achievements (e g , income and communis 
service) These \ anables are of ten estt mated thi ough quantitatu e methods, 
although qualitative approaches mav be more appropriate for some varia- 
bles (personal growth measures, for exam pie) Outcome indices arc thought 
to result from interactions between context, input and involvement 
v anables 

The distinctions between clusters are not pure For example, vvhethei 
s% sterna proper tics of institutions such as norms and decision-making 
strategies are most appropnatelv placed in the context or the involvement 
cluster is difficult to deter mine What is most important is not where the 
variables are placed but whether ihv variable is included and vhethci it 
illuminates how qualm in th" student experience c an be assessed 

Context Indices 

When considered as coiieLn ^ oi qih.htv context indicators are often 
thought of as envir.Him tal factor^ (AMtn 1^77) or ' icsources" (Sc ort 
1**80-81 ) 

In*titu*ion size, Students at high » M, Mr.allei in dilutions hav e been louiict 
to achieve (as mea-an ed In ORRsMt higher lev els than then couutci paitsat 
larger institutions ( Roc k tentia and Linn 1970) Vet in another stuck, the 
si/c of the institution was found to be unrelated to ac adenue achievement 
{Ast«n i^6*a} However cocurruuiai achievement (eg student govern- 
ment offices athletics, cK )has been negativeK v on elated with si/e, that is 
students at smalle r institutions tend to exhibit m»ne coc in r k ulai achieve 
merits vAstin 1^77, C hickermu 

\1eeth (1^74) suggested that si/e of depaitmcnl could he i elated in 
\erselv to o^alilv That is, a-» *he depar tmeni inu cases m si/e (numhei of 
.out ses). fucuhv usualiv have hea< ,er leae lung loads, i esuiting m less time 
available to -.nend with more students Converseiv Milieu ( Ws)) warned 
that a college can per haps be too small to ensure qualiiv and posited that at 
least four fatultv rinmhtr^ die lecniued to adequat,lv provide a major 
degi ee of studv 

\t the least, si/t sc l aii to he r elated to per c en cd r eputaUon ami pi estige 
of the institution" 'Preoccupation with the numerical M/e of a college 
obsc ores the real significant cot the issue of si/c, whu h is the expeueiu er»/ 
bc'onvnxne\s" (italics (Heath p 241) (hkkenng 

posited that as the si/c of the institution increases, the opportunities 
decrease for students to assume positions of leadership in institutional 
government and social organizations (see also Pa%.e 1^81) He suggested 
lamer institutions he subdivided into smaller liv m^-leai rung v lusters to 

* Ait k .unlet *\su» pv isniial e ernimniu ation 
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increase the opportunities to become actively involved in the life of the 
institution After a review of the research and opinion relating size and 
student outcomes Bowen (1977) concluded that "smaliness is associated 
with educational advantage" (p. 248). 



Institutional purpose. Numerous writers have linked quality of student 
expenence with salience and clarity of institutional purpose (Chickenng 
1969, Astin 1980a; Meeth 1974, Keeton i*7H Institutions with numerous 
missions and purposes send mixed messages to students and facultv that 
tend to distort the sense of community considered important fo** a "de- 
velopmental^ powerfi-1" expenence (Chickenng 1971). Heath (1968) has 
eloquently underscored the importance of a salient institutional purpose to 
quality of experience* 

A college community that has an ideal or vision has, in effect, expecta- 
tions of w hat its members are to become. Such ideals or expectations, so 
out of fashion nowadays, may be more silent than vocal they may wo*k 
their effects out of awareness; they may constitute the invisible col- 
lege... And when such expectations are consistently expressed in all* 
-'ructures and activities of the institution, then different communal 
expeiicru es may mutually reinforce one ano .ier. It is rare that a specif ic 
type of educational experience is very significant. Rather, it is the 
coherence, the consistency, the "atmosphere". . . that makes its impact on 
development (p 243} 



In most of the empirical studies related to institutional purpose, qualitv 
has not been operationally defined; i athtv subjective impressions of institu- 
tional contributions to students' development have been used as the 
dependent variable. Concluding that salient institutional purposes are po< i- 
tively related to high-qualitv student experiences is a product of deductive 
reasoning. For example, the degree to which institutions are able to articu- 
late their purposes »s thought to be related to a more informed college 
selection process (Kuh 1977). That is, students themselves select an institu- 
tion with a mission congruent with what the students and other influential 
people (e.g parents) expect jm college Therefore, students are more 
satisfied with their e xperiences, are able to work harder with greater satis- 
faction towaid then goals (that bv definition are consistent with the institu- 
tion's goals), a',d rema n in school until they attain their educational 
aspirations 



Formal and informal organizational properties. Troutt (1979) suggested 
that of the eight evaluative critena often used by accreditation teams, the 
formal organizational structure of the institution is one of three critena 
related to quality Conversely, others have argued that the degree to which 
students understand how the institution is supposed to function (e.g., lines of 
authority source** of runding, levels of decision making, etc.) is related to 
students' satisfaction and that as many students as possible should under- 
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stand the institutions organization (Bcne/et 1981, Berdte 1972) Further, 
students' roles in institutional decision making have been conceptual! \ 
linked to reduced rates of attrition and therefore have been inferential! \ 
associated with higher qualm learning experiences (Bean 198!) While the 
latter arguments have some intuitive appeal, empirical evidence does not 
exist to support a conclusion that certain formal administrative or organiza- 
tional structures are more close! \ linked with qualitv than other structures 
(Bowen 1979) In fact, whether formal organizational structures e\plain 
much of what happens most of the time in institutions of higher education 
has been questioned The'alternative organizational perspectives" illumi- 
nating how institutions actuallv function as opposed to how thev are sup- 
posed to function (i e , the Webenan bureaucratic model) mav have heuris- 
tic value for better understanding the relationship between qualitv and 
college and university management (see Cohen and March 1974. Weiek 
1^79) 

Whet her grading prat tices are related to qualiU is unclear W ilson (1970) 
reported that grade point averages actual I \ declined during the 1960s, a 
time when the average abilitv (as measured by entrance examinations) of 
students maikedlv irereased However, during the latter 1960s and the 
1 970s, grade inflation was widespread throughout h.gher education (Birnbaum 
1 977) During the same pel tod, entrance examination scores declined {Col- 
lege Entrance Examination Board 1977) One explanation for the higher 
grades awarded during the 1970s suggests that grade inflation wasfaculiv \ 
delav ed adjustment to the increased "quahtv " (abilitv ) of A udents in the late 
1960s ft is aNo possible that some professors, partieularlv those in depart- 
ments wih few majors, mav have felt threatened bv predicted and some- 
times real enrollment decreases and awarded highei grades to'encotirage" 
students to take their courses (see Birnbaum 1^77 to: additional explana- 
tions of the grade inflation phenomenon) Astin (1^77) has aigued that 
grades ar e an important source of feedback for studenN and mav serve to 
motivate and i einfoice certain valued behaviors like shaking and inter ac 
tion with fatultv On balance, however, the literature is uruleas as tti the 
relationship between grading practices and qualitv 

Pascarella ('980) and Webster M98U) have suggested that qualitv is 
related to the amount of time that facultv spend teaching, advising, and 
mfoimallv interacting with students Facultv act as important socializing 
agents 

I he tnti'niL turn heiwetn the faadts and students formalh and mfot 
walk staves as the hasn th v trail h^moh of attitudes and \ahies jrtnn 
the pr tfesstonal to the neophyte, The most successful socialization, 
meast,*edirt terms of congruent v between the profusion's goals and the 
existing nt-oplnte's identity, is a prodiu t of a successful tout hmg rela 
Hon* up, a consensus among fatuity of the goals to he achieved, and a 
perception of the adlegiahtv or acceptance on the part of the student 
Both formal and tnfom. 1 interaction tontnbute to these conditions 
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A student-oriented norm or expectation probablv exists in those institu- 
tions (usual! v smaller private colleges; in which the degree uf student- 
facultv interaction is fairly high ii has been suggested that the facultv 
reward svstem be restructured tu encourage more interaction with stu- 
dents—that is tudeemphasize inquiry and external serv ice contributions and 
tu emphasize teaching and carrprs service contributions to students and 
others— which will in turn increase oualitv .Student Task Force on Educa- 
tion at Stanford 1973). Gaff and Gaff (1981), for example, believe such a 
norm can be supported through a furmal reward system Certain environ- 
ments— such as small colleges that emphasize the importance uf the teach- 
ing mission ui cluster colleges in which students and facuhv with similar 
interests are more likelv to interact — seem tu create the conditions that 
foster productive relationships between students and facultv (Wilson et al 
1975) 

W he* her a lelatiunship exists Vuvcen facultv murale as a socializing 
agent and quality in the undergraduate experience has nut been empiric all v 
established Nevertheless, it seems logical to expect that facultv vuth high 
murale wuuld be more enthusiastic about their wurk and therefore wuuld 
be mure efficacious rule models than faculty with luw morale (see Clark and 
Kuh 1981 for a discussion uf the relatiunslup between svstemic organiza- 
tional properties and faculty morale) 

Financial resources. The literature concerning the relationship ol qualitv to 
cust is nut definitive. On the one hand, Truutt (1979) considered an instuu 
tiun's financial resuurces tu be positively related tu quality Ruck, Centia, 
and Linn (1970) found that institutiunal income per student was related to 
higher GRE scores Adams and Knsluv (1978) reported significant correla- 
tions between a facultv salary dispersiun index and both the Gout man 
Rating IndeK (a specious index of institutional qualitv— see Webster 1^80 
tor a critique of the methodology used to develop the Gourman Rating 
Index) and selectivitv indices popularized bv Astin (1968a) In addition, 
Solmon (1972 1975) reported statistical^ significant relationships between 
facultv salarv and the subsequent incomes of a sample of college-edu< <»tcd 
persons According to Solmon ( 1972), the use of facultv saiarv as a surrogate 
indicator of qualitv is based on the assumption that more competent faculty- 
make more monev However, facultv salarv indices tend to militate against 
certain institutions — usuallv smaller, church-related institutions— that do 
not havegt aduate programs because graduate school facultv tend to make 
higher salaries and therefore inflate the salarv index 

On the other hand, but hMecth{ 1974) and Millett 1 1979) have argued that 
costs andq*iaM\ are not necessarily perfectly related Inhisstudvof hbeial 
arts colleges, Meeth found that the cost per student was not correlated with 
institutional size and concluded that "higher cost colleges do not ne< essar iK 
produce better quality graduates" (p 97} 

Using student achievement as a manifestation of quality, Astin ( 196()a) 
reported that the traditional indicators ol financial resources, *ut h as size of 
library collection and expenditures per student, did not contribute or "add 
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value" to students' achievement as measured bv GRE scores, however, 
abilitv of entenng students and expenditures per student werei elated to the 
perceived affluence or prestige of an institution (Astin and Panos 1969) 

The evidence appears equivocal enough to preclude inference that a 
direct, causal link exists between cost and quality Nevertheless, it is tempt- 
ing to resolve the question of whether financial resources are related to 
quahtv bv reiving on the 

universal tendency to nidge institutional results or quality in terms of 
inputs . .and to a.*swne without evidence that more [resources/ some- 
how will inevitably protiuce tommensurateh greater or better results 
. .There is a serious logical problem, however, in declaring that cost 
differences are due tc differences in program It is h\ no means clear 
whether expensive pmprants ate a result or a cause of high costs (Bowt n 
mt.pp 24-25} 

Student living environments. Perhaps as much as 75 per tent of a resident 
student s time during college is spent participating in activities unrelated to 
the formal academic curriculum (DeCoster and Mable 1974) Wilson (1966) 
estimated that perhaps as much as 70pe r cent of what students learn during 
college results from out-of-elass experiences The living environment is a 
critical factor that must *v» considered when assessing the qualitv of the 
undergraduate student experience, panicularlv for resident students of 
traditional age "When unplanned, this learning mav be either positive or 
negative In the past, it has been large I v uncoordinated with other learning 
occurring elsewhere. . "(Riker 1981, p 672) 

Brochures describing campus life are replete with statements under- 
scoring the importance of the environment to a quahtv educational expe- 
rience (see DeCoster and Mable 1980). Considerable reseauh has been 
conducted to estimate the degree to which certain college living environ- 
ments — residential versus commuting (Chickering 1974, Astin 1977) and 
ftaternitv andsorontv hoi'-ing(Feldmanand Ncvvcomb 1969)— aie related 
to personal development outcomes In addition, Williams, Reilley. and 
Zghc/vnski (1980) have summarized the relationships of different living 
arrangements within various kinds of residence hall environments, for 
example, coeducational living units and resident hall floors comprising 
students with the same major Thev concluded that "students living in 
residence halls make bcttci grades, ar e more motivated to complete degree 
programs, have better attitudes about their college or universitv Mid are 
more involved in social and academic activities on campus" (p 114) 

A variety of instruments exist for estimating the quality of student living 
environments, and several have received extensive use College Universitv 
Environment Scales (Pace 1969), University Residence Environment Scales 
(Gerst and Moos 1972), C >llege Characteristics Index (Stern 196° Stern 
1970) Baird and Hartneti (1980) have summarized more than 20 instru- 
ments of environmental assessment that ran be used to monitor the quahtv 
of students' living enviroi nents 
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Summary. Most of the empirical studies relating quality to context variables 
have correlated unidimensional, quantitative manifestations o\ qualitv (for 
example, achievement scores and postcollege i.icome) with quantitative 
indicators of context (tor example, expenditures per student and facultv 
sa lanes) Size of institution and its claritv of purpose have appeared func- 
tionally related, and both have been found to be correlated with qualitv, 
expenditures per student have not necessarily been tied directly to commen- 
surate degrees of quality Opinion has been divided as to whether formal 
and informal organizational properties are related to quality. While norms 
supporting facultv i .traction with students seem important, grading prac- 
tices have not been related to quality. Various kinds of hv ing environment** 
have been linked to qualitv, particularlv for traditional-age students 
Whether a relationship exists between living environments and qualitv of 
the undergraduate experience lor older, part-time students has not been 
determined 

Input Indices 

Input measures are considered the most popular method of estimating 
quahtv (see, for example, Bowen 1981, Maher 1974, Millet t 1979) and have 
almost alvvavs taken the foi m of quamitativ e indicatoi s 

Ability. Most institution** have used students' rank m high sc hool class as a 
surrogate indicator of qualitv (Kuh 19 7 7 Watts 1977) High school lank has 
rarelv been used in studies involving several institutions, however, because 
of the variations m gr admg standar ds and students' abilitv heliev cu to c\iM 
across high schools 

Scores on entrance examinations sue h as the Scholastic Aptitude Test oi 
the Arneican College Testing Pi ogr am ar e the mdieatoi s most often used to 
infer qualitv For example, Astin (1968a) and Astin and Pano« (I97h 
reported that the average academic abilitv o! entering students was i elated 
to qualuv (defined as perceived affluence or pi estigcj of the institution, this 
relationship has apparcntlv remained fair I v stable over time (Astm and 
Solmon 1979) Some have periodic allv questioned whether openoi loweied 
admissions standards have a debilitating influent e on qualitv (Agnew 1M70, 
Meverson l' J 75. Fonsor 1971 > At some institutions, up to 7S percent of 
entering college students have been judged to be it! prepared for college 
woi k and to requne some soi t of lemedial assistance C i ttcsof open admis- 
sions sav that such large numbers of students with serious deficiencies 
"i educe educational qualitv for eveivone' (Flagler 1981 p j) hmpincal 
data are lacking to support siu h assertions, hove ever (see Lav in, Alba, and 
Silbeistem l l ^9) 

Few would argue that student abilitv is com^letelv unrelated toeduca 
tional qualitv Fxc lusive reliance on measures of abilitv as a reliable indica- 
tor of qualitv is probablv rnvopie in the absence of additional evident t 
dot um en ting w h ether student-* use then talents to good ad\ ant age It is no! 
surprising therefore that most attempts to determine 'qualitv" have linked 
abilitv with certain outcome vanabh's, usual! v achievement 
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Biographical characteristics. Various biogiaphical variables have been 
inf erentially linked to quahtv , depending on the purposes and mission of the 
institution under studv For example, gender is obuousiv important if the 
institution is a single-sex college with a missio" to piepaie its smdents for 
leadership in education, business, and industrv (Astin 1977) College cata- 
logs often imply that because a number of students from foreign countries 
or from different states attend the institution, the quality of the educational 
experience will be enhanced because of thediverse cultural backgrounds to 
which the undergraduate student will be exposed How ihese student 6 are 
integrated into the social svstem of thei .Mitution is probablv morecloselv 
tied to quahtv than the number of students in attendance 

Whether such variables are indeed important or even related toquahtv, 
however defined, has not been demonstrated empiric all v, howevei It is 
unlikclv that biographical indicators, with the po.^ble exception of gendei, 
arc related toquahtv (see Astin 1977) 

Nontntellectfve characteristics. The importance of nomntellective indica- 
tors such as participation in extrac unicular activities in high school, inter- 
ests, and aspirations is often under si oied bv admissions personnel seeking a 

'rich mixture" of students (Kuh 1977} Such a mix is thought to enhance the 
opportunitv lor a personaliv liberating college experience and therefore 
contribute to a higher quaiitv educational experience (Wilhngham 1^80) I i 
highlv selective institutions where a large number of qualified applica* ts 
compete for a limited number of places m the entering class decisions on 
admissions sometimes are based on nonrntellec tivc variables (s< e Chmnu lv 

1981) 

Institutional environments congruent with entei students' c hai ac tei 
isties and expec tations icsuU in students' greatei satisfacuon w th tK ir^ti 
tulion and therefore a quahtv educational experience (Moo- 197s 1 . Pace 
196^ Per vm and Ruhm 1957, Stein 1970) The environment s, io << large 
extent, what people perceive it to be Manv of the mstr unents sumiiuu i/ed 
bv Band and Hai tnett \ 1 980) for use in assessing the "qualit v ' of {he college 
env ii onment— the College C haraclenstics Index, toi example— ai e giuimdetl 
in perceptual theorv 

From thecharac tenstics and preferences of a Lune number of entei ihg 
students, Astin (1968b) identified six nonrntellec tue factor intellectual- 
ism, aestheticism. status, leadership, pragmatism, masc ulmitv — that differ . 
entiated between \anuu> kinds of institutions Foi example, technologic a! 
institutes like M IT have heen found, based on the characteristics of enter 
ing students, to differ from libcial arts colleges like Oberlrn or Gnnnell on 
the factois of aesthetic ism, pragmatism, and masnilmitv Presumablv stu 
dents with characteristics consistent with the dominant factors of a given 
campus will "fit" better and therefore be more satisfied 

The fit of student* and environment can be a two edged sword, ho-vever 
On the one hand, students can become acclimated so easilv to a college's 
environment that few challenges are presented to students' preferred wavs 
of rhmkmg and behaving In this instance, students' development mav be 
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stunted. On the other hand, students who are repeatedly challenged and are 
without appropriate sources of support may become so dissatisfied that 
they leave the institution. In general, development seems to be encouraged 
in an environment that requires a reasonable amount of adaptation (Snyder 
1971) and a number of new responses from the student. That is, curncular 
and cocurricular challenges that upset students' equilibrium and encourage 
them to greater degrees of differentiation and personal integration are 
considered necessary to encourage development of the "whole person/' a 
goal to which most institutions subscribe (see Knef elkamp 1 980* Perrv 1 970 
Sanford 1962). 

Summary. Although measures of ability have been the most often used 
input indicators of quality, exclusive use of ability measures does not reflect 
the institution's or students' purposes for higher education, the effort stu- 
dents make to attain personal or institutional objectives, or the degree to 
which students benefit in various ways (acquisition of information, social- 
emotional maturation, critical thinking) from attending the institution. For 
these reasons, ability measures have often been linked with context indi- 
cators and outcome manifestations to infer quality. Biographical variables 
haveoften been logically linked with quality, but empirical evidence has not 
been reported to substantiate the validity of the inference. The degree to 
which students' nonintellectivecharactenstics are consistent with the dom- 
inant environment of the institution has been inferential^ related toquahtv 
because of the empirical relationship between congruence of certain char- 
acteristics of students and their environment and students' satisfaction uith 
the institution 



Involvement Indices 

Astin and Scherrei ( 1980), Pace (1980), and Scott (1980-81 ) have provided 
the rationale for emphasizing involvement variables in quality assessments 
QuuIiU is more a function of what students do with an institution's re- 
sources (context variables) than of the resources themselves Involvement 
indices have been used less than other qualitv indices for at least two 
reasons ( I ) recognition of the importance of active involvement of f ultv 
and particularly students in effecting qualitv in higher education has onlv 
recently been underscored (Astin 1977, Pace 1980); and (2) involvement 
measures have not usually been included as part ot institutional manage- 
ment information systems (Astin 1979, Astin and Scherrei 1980) As a result, 
involvement indices reflecting manifestations of quality are not readily 
a\ ailable 



Involvement with peers. The degree to which students are involved and ar e 
satisfied with their involvement with other students has been correlated 
wit h quality (Astin and Scherrei 1 980; Feldman and Nevvcomb 1 969). Partici- 
pation in almost any extracurricular activity seems to be positively related 
to persistence, certain desir able changes in personal development (see Astin 
1977 for differences tn degree of change related to involvement in inter- 
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personal, academic, and athletic activities), attaining career objectives, and 
general satisfaction with the undergraduate experience {Astin 1977, Kegan 
1978), 

Chickenng (1974) underscored the importance of the peei gioup to a 
quality educational experience "Once a person identifies himself with a 
group that group becomes an anchor and a reference point The values and 
behaviors approved by the group provide a background for developing 
individual attitudes and behaviors." (p. 88) 

The influence of the peer group on the quality of the undergraduate 
experience mav be a function, in part, of the amount of time available to and 
used bv students to interact with each other For example, Wilson estimated 
that over 70 percent of what a student lear ns in college results from out- 
class experiences (1966) If, in fact, students do spend the majontv of their 
time in col lege with peers, the importance of the pee i group is clear, particu- 
larlv for resident students Chickenng (1974) reported that the development 
{as reflected bv a vanetv of attitudinal and value-onented scale* from the 
Omnibus Personality Inventorv) of students living in campus housing vva^ 
accentuated compared with their counterparts living at home The differ - 
ences in personal development have been attributed to the relativelv fewer 
opportunities commuter students have for peer interaction (Bragg 1976) 

However, involvement with certain peers can be debilitating For example 
students involved in peer groups with different or less positive orientations 
toiollege mav reinforce behaviors inconsistent \, th the aimsof the institu- 
tion (see Stern 1962), theiebv bet oming less satisfied and perhaps leaving 
the institution 

Instruction. The hteiaturc on quality of instruction can be divided into two 
areas intended learning outcomes, and teaching methods consistent with 
students' characteristics such as learning stvle and intended instructional 
outcomes (Mengea 1981) Mcnges analv/ed the conditions required lot 
attaining each of five categories of outcomes (1) psvehomotor learning— 
skeletal-muscular reactions mediated bv cognitive knowledge, such as plat- 
ing a musical instrument or pel suasive ora! communication, (2) memorv — 
minimally complex verbal recall tvpicallv requiring repetition 0) complex 
cognition— classification, analysis or svnthesis of recalled knowledge in 
different contexts, such as developing principles or the relationships 
between concepts, (4) nonlinear cognition— holistic and expansive 
processes rather than the analytical, reductionistic processes connoted bv 
i omplcx cognition more tvpical of "creative" persons (see Heist 1968), such 
as the capacitv to dream and meditate, and (5) emotional learning- 
identification and expression of one's own and awareness of other s feelings 
(See Gagne 1977 for another taxonomv of learmng outcomes) Menges 
posited that students should be able to demonstrate competence in each of 
these five learning categories for the aimsof liberal education to be realized 
A variety ot different conceptual frameworks have been put forward to 
better understand characteristics of learners Cross (1976), Knefelkamp 
(1980) Kolb (1981), Messick et ai (1976), Pern (1970), and Wttkin et al 
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(1977) have* un d ci^luic J the lmpoitincc ol learners' <. harac ter.sttcs lo 
learning and development ol ihe intellect Kncfelkamp in particuiai has 
articulatclv encouraged lacedtv to use concepts from human development 
theoiv to improve the* qualitv ot instruction However, lelativelv little is 
known about the instructional pi eferenccs i>i st vies of facultv (Koib 1 98 1 is 
a notable exception) 

A considerable amount ot leseaich has been conducted on the i dative 
effects of vanous instruct, anal methods (see Gape and Berliner 1979, 
McKeachie 1978) Although the lecture format is used most often, tew 
advantages to learners have been associated with this teaching method 
Menges ( 1981 ) has summarized the relative Mi engths o\ other msii uctiona! 
techniques, given the intended outcomes 

Jo at hievi memory outcomes, the learns must rehearse \ e^bal asso- 
( lattvn and verbal c hange Listening to a let lure is pas six c hm tei ttation 
t)t ( omputer assisted drill ensures rehearsal ToachteVi ''ie masten of 
emotions neiessar\ for accurately perceiving emotional messages from 
other leUffu rs must 'eceive real messages from other persons \ bonk of 
Kisc statics is not sujfu lenlfvr stu h learning, but groupcxeu ises max he 
p s7gj 

From an extensive review ot the liter Jure, Menges concluded, that 

thou e of in stun tional method should be a / unit ion of both intended 
learning ijutt omes and the setting in whu h learning ot c urs (< ijnvementh 
represented hx group size), mth due regard for leamet and leather 
k haratteristu \ Thi ma^or criterion for assessing appropriateness uf 
r*:elho/ J is the extent to whu h the method ensures that learners pur^i. L 
(asL\ essential to the desmduun omes //>/> 57H-'? 1 )} 

Instructional behavior has also been related to hcquerKV ot .utntmal 
contacts with students out of the classoorn 

Differem es in fat ult\ accessibility to student' out suit of class appt ur to h t 
related to individual c harat teristu more ( omplex ihari the i om entumal 
i lustering of aiaiierriu disc iphnes. [I Jhose fat ult\ most at < cssihlc to 
-udents bewnd the classroom appear to she re an interrelated set of 
not nis. assumptions, and values about the proi esses of teat hing, learning 
and student developme t ?t of which frequent informal eontatl with 
* tudenls outside of c lass would seem to ht a natural extt ?isnm (Pasi atella 

m&tf p *> 0 2i 

facultv behavior related to qualitv instruction goes bevond formal 
course sv llabi and class assignments In what Snvder (197 1 ) has termed the 
"hidden curric ulum," facultv communicate m subtle wavs to students what 
behaviors ; rewarded At times, such behavior is actually mLonsistent 
with the formal vetbali/ed requirements stated bv ptofessois 
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I observed the professor in one tluss beginning the term h\ explaining 
that the students wen expei ted tube cre>itt\ eimdttn ulved, in short, the\ 
w ere to be engaged fhe\ w ould have the oppot tunxt\ to ud e intelk c tual 
risks, tomakes mistakes, hive wee k> later tin fit \t quiz was given I he 
students found that :he\ we*e asked to *eiutn a large amount of 
information that the\ iould only have mastered h\ memofzation Thete 
was a considerable dtsitepantx between the students' expectations for 
the course and what they were in fai t exptc ted to learn in order to pass 
(he quiz In spite of the professor's opening pronouncement, the hidden 
but require 1 ta,k was not to be imaginative or creative but to pla\ a 
specific, tightlx circumscribed academic game (Sn\cht 1^71 pp /£ / 7l 

For some students, the disuepancv between what is stated and what ^ 
actuallv^ivquned creates considerable di-^onance and hu^tiation some 
t : »s >^s Ltiiminating in attrition 

Informal faculty-student Interaction. The Student Task f os .eon \ ducat i«m 
at Stanford (1973) identified informal student-facuitv interaction as one of 
the most important components of aqualitv undergraduate education <sct 
alsoSanford 1967, Trow 1975) Students who report higher levels of inter at - 
lion with faculty also report more satisfaction with college (Pascarella 
i980), ev idence higher degiees of achievement as ret let ted I \ standardized 
tests (Centra and Rock 1970), are less hkeK to drop out (Bean 1981) aiiuaii 
more hkeK to ask advanced degrees (Thistle vaite 1959) 

In addition, "thefdcultv member can be a .oie model of successful adult 
beha\ lor He can be a sourc e of motivation, a c ntic or a judge, or a c ataK st 
in the students' reorientation of his value svstem'\Feldman and New comb 
1969,p 251) "The" feedback he gives influences the students self image as a 
learner and as a human being" (Bragg 197ft, pp 34-35) 

The empirical evidence seem ncquivocal Facultv student inter action 
is an importam part of a quahtv undergraduate experience Vet t<> be 
addressed is whet her st udents can su.c essfullv b»- . i our aged to w ill i" * u t 
become more involved with facultv an ] ,\c \eisa 

Student effort. The importance of student effort or initiate in making the 
most of institutional resources is not a net incept (see Blown 1917), but it 
hasreccntlv been undei scored again (see Pace 1980) In tact, "a large b<»d v 
of evidence (Bloom 1974, Gagne 1977, Kulhavv 1977) shows that students 
'earn best when thev invest time and energv in the learning task" (Astm 
i 980b, p When commenting on the woef ul lack of diret t c on tact between 
students and facultv, the Student Task Force on Education a: Stanford 
( i 97^) blamed bot h the systemic properties of the institution (not nh, r eward 
svstem, etc ) and the lack of student effort in taking advantage of existing 
opportunity foi such interaction The Task Hirce recommended that 
undergraduate students be made aware of the importance of and then 
shared responsibility for participating «n these kinds of activities 

Pace (1979, ls>80, 1^81 ) has called attention loan important distinction 
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between the amount ot time students are involved in an activity like study- 
ing and the quality ut time invested in the activity For example, outlining 
required leadings or interpreting major points to another requires more 
effort and is more educative "than met el v underlining passages in a text- 
book" (Pace 1980, p 10) Based on the findings from a studv of 13 colleges 
and universities, Pace reported, "the higher the qualitv of intellectual 
effort, the higher the grades" (p 14), and the more time spent on academic 
matters, the highei the quality of effort likelv to be invested in taking 
advantage of other opportunities available on campus Apparently, "what 
counts most is not who vou are or where vou are but what vou do" (p 16) 

Whether facultv or others like student affairs staff and academic 
administrators can successfully encourage students to increase "quality" of 
effort is not known Also uneleai is whether students w ho expend consider- 
able effort during the undergraduate years may be different in important 
wavs (like motivation and ability) from peers who invest less effort The 
evidence to date has suggested that hignlv involved students are different 
from their less involved counterparts. The former come from educated and 
relatively affluent families, earn higher grades in high school, and score 
higher on college entrance examinations (Astin 1977) 

Current methods for assessing the quality of student effort are quantita- 
tive and rel> exclusively on students' reports about themselves While the 
"quality of effort" scales appear to have heuristic value, they hav^ not been 
validated bv other measures such as observations, interviews with room- 
mates, and so forth fn spite of these limitations, "quality of effort" is a ru h 
perspective horn which to better under stand quality in the undei graduate 
student experience 

Summary. The frequency of students' interactions with significant others 
(e v , peers, facultv, student aft airs staff) in the institution has not been used 
verv often as a manifestation of quality This lack is surprising, given the 
overwhelming empirical evidence and opinion linking peer interaction and 
student facultv interaction with a variety of surrogate manifestations of 
quality like student satisfaction, achievement, and persistence The qualitv 
v)t ef fort both student sand facultv put forth in their interactions provides an 
additional and perhaps richer and more powerful descriptive perspective on 
qualitv Qualitative strategies mav help ameliorate the apparent limitations 
of current methods to assess quahf of effort 

Outcome Indices 

Outcome variables appear to be second to inputs in frequency of use as 
surrogate measures of quali'v and are usually assessed with traditional 
quantitative methods Outcomes are often considered "better" than other 
indites of quality because thev potentially represent the "value added' b\ 
the undei graduate experience (Hodgkinson 1981. Millett 1979) 

7 he ha^u at burnetii under hi fig the value added appttmih is that true 
quahts rt^tde^ m the institution's ahiht\ to affectum students favorably to 
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make a pontine difference in their intellectual and personal dex elopment 
The lnvhest-quahtx tnsiituiion\ w this vtew, are those that have the 
create t uapait—add the most value — to the student's knowledge, per 
^onah . and career developnn nt (Astin l^HOb, pp 1-4} 

Persistence. An important and relativelv eas> to produce estimate of 
.v hether institutions are meeting students' expeeiatio. s is rate of retention 
fAst'" '^79) For example, Grusori, Levme, and Lustberg f 977) have urn- 
tender v.iat the degree to w hich students persist to the com* turn of then- 
degree objects es is a valid index of the quahtv of the undergr aduatc expe- i- 
ence Both the institution and the students are thought to benefit 1 ecause 
persistence is linked with a stable enrollment, which is related to a stable 
financial base (a popular context indicator of quahtv ), and students' satis- 
faction with college, suggesting that thev are receiving adequate prepara- 
tion tor v< eational, civic, and familv responsibilities Student per sistence has 
also been cor related with ( I ) the frequencv (Pascarella 1980, Pascarella and 
Terenzmi 1977 Rossmann 1967,Spadv 1971 ) and "qualm " (Pascarella and 
Teren/ini 1977) of informal student-facultv interactions (2) involvement 
with peers and institutional activities such as social organizations, honor 
societies and athletics (Astin 1975, Astin 1977.BLke Wl.Siebei 1Q7HH- 
general satisfaction with the mstit ution ( Kegan 1 978), (4} self esteem and { ^ ) 
undergraduate grade point average (Astin 19*75, Astin 1977} 

The apparent conceptual !ink between persistence and quahtv ma* be 
spurious ror those students vvhodonot "fit at one institution or who require 
a more "dev clopmentailv powerful" environment, that is, an institution 
prov iding optima] challenges that encourage students' dev elopment (C flickering 
1971) roi example, Heist (1968) reported that highlv creative students, 
manv of whom are among the most academic a IK able at their respective 
institutions, arc disproportionate^ represented among dropouts or transfei s 
Reducing the number oi these creative people who leave college continue-, 
to be a major challenge Howev er, an institution ot h.ghei education .anno! 
hi* all things to ail people Assisting students u he transition from one 
institutional environment to another more suited to: hen need- mav well fu 
an earmark jf a quahtv institution (Kuh 1972) 

Achievement "Theoverw helming weight of evidence is th.it, on the aver agt 
students make guns in substantive knowledge during the college veais' 
/Bow en I977,p 68, see also Lear ned and Wood 19?8, Lenning, Mundav.and 
Maxev 1*69) Whether grades and quahtv are r elated has been difficult to 
determine for n vanetv of reasons For example, grading practices mav 
differ between and within institutions, students majoring in the sciences 
rnav rev,: 1 e lower grades even though thev tend to be as intelleetuallv able 
or more able compared to their counterparts in other major fields (Astin 
1977. Hood and Swanson I96S) In addition, grades are relative onlv toother 
students at the respective institution at i giver, time and do not reflect what 
a stu kmt h s learned (Astin 1974) 
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It is no: dear whethci certain fat u ji s arc related to levels of achievement 
different from those predicted bv m intents' entrance examination scores 

iihuvement ius measured h\ the three urea tests of the Graduate Rei * » d 
Examination administered dm mg the senior \ ear in college) is neither 
impfo\ ednor impaired h\ the intelU\ tual level 'of classma^ \orb\ tht 
lex ! of academic competitiveness Differences among studtnts in 
th^irachiexement . are much morei lose ly linked to variations inabiht\ 
that existed prior to the student s entrant e than Joans t harac ten >/r< of 
the undergraduate institution (Astin and Pano* , M9, p 14^) 

Although others have reported similar findings (Nichols 1964) more recent 
dd\A suggest that under graduategtadepomt average is negatively related to 
institutional selectivity lie. academic ahilitv) of entering freshmen {Astm 
1977) 

In a studs of 9S institutions. Rock. Centra, and I jnn { 1970) concluded that 
theonlv institutional v anables linked to achievement (as measured bv GRP. 
scores) were expenditures per student and propor lion of lacultv with docto- 
rates Smalle* institutions with higher revenues per student seem to have 
had an accentuating influence on students' achievement 

Students who are high achievers also are more likelv to informally 
interact with faLiiltv, be involved in campus activities, and m> forth Pasca 
rel j a (1 980) has warned, however, that causal direct ion is not clear ' Does 
informal interaction with facultv positively influence academic perfor- 
mance, or is it initial perception^ of academic success w hiLh c^ entuallv lead 
students to seek contac t with facultv bevond the classr(X)m 1 ' (p 5S8) 

Prestigious awards for graduate study mav be more a function of stu- 
dent abihtv (inputs) than a manifestation of a quality undei graduate expen 
enee For example, Roc k t Centra, and Linn ( 1970) did not find a relationship 
between proportion of students seeking advanced degrees and ^titutior.al 
i(ontcxt) variables Astm (1977) reported mixed findings For example, 
graduates of selective institutions were less Irkelv to attend law school, 
although the i names of attending medical school weie increased slight Iv 

When implementation oi occupational or graduate school plans are 
considered the quality oi the undergraduate institution as measured bv 
students abihtv seems to have minimal impact (Shaip 1970) 

Intellectual and social emotional development. Many researchers hav e con- 
cluded that on the average college students tend to become more liberal and 
sophistic ated in their political, social, and religious views and to evident e 
more complex and autonomous thought processes (Ellison and Simon 1973, 
Trent and Medsker 1968) These changes were apparently a function of both 
maturation and college attendance At the least, college attendance has 
seemed to have an accentuating influence (Trent and Medskei 1968) The 
data have been equivocal as to whether context indicators like si/e or 
expenditures per student are related to differential degrees of change For 
example, (bickering, McDowell, and Campagna (1969) concluded horn 
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their studv of H colleges that average changes on inteiieetual (eg, auto- 
norm , theoi etical orientation, complexit v ) and social emotional (e g , .social 
extroversion, impulse expression altruism, anxietv) scales of the Omnibus 
Peisonaiitv Inventorv were consistent regardless of the institution's staled 
mission or purpose Clark et al (1972) and Trent and Medsker (1968) 
reported similar findings using comparable forms of the same instrument 
administered to different populations 

Alumni. A numbei of researchers have studied the economic benefits asso- 
ciated with college attendance In general, individual (private) rate of return 
on t he investment in a college educ ation ranges f r om about i 5 percent to 1 8 
percent more than that on a high school investment, depending on the 
assumed relationships between learning capacitv and income used to com- 
pute rate of return (Alexander 1976, Becker I960, Ravmond and Sesnovvit/ 
1975, Warner 1976) In studies specificallv designed to deter mm * whether 
i at** of return vanes bv specific kind of postsccondarv institution attended, 
qualst\ has usuallv been defined as an attribute of the institution that 
increases earnings in later life Using variables like student abilitv at 
entrance, facultv salaries, and the Gourman Index as M ual (v indicators, 
Solmon ( 197S) found that attendant eat high "qualitv" institutions resulted 
in greater economic returns The rate of leturn seemed to increase with 
exper icnce t i the labor fou e, tha* is, alter being out o! college loi sometime 
(see also Solmon !97VWachtcl 197^) 

Must studies inujirm that students w ho %o h.iolh'w s of Inche* qnahn 
tutu mute })intw\,an' more wac essfultn graduate st'ith, than students <>f 
equal ahtlitx at d hat {^rounds w ho^u Un alleges o/ /os< r quaht\ I he 
numelut return on imesmieMs m college quahl\ appeal t<> he n>i the 
order of 7 m S per i ent tiiouin /°"7, p ?$c*i 

\ number tA iru omc indues have lunuations that aie serums enough to 
qikstion ihen use as maiiilc stations of qualitv F oi example, the validitx of 
the (huh man uun^ ami Lu ult\ salan as n.tliuUuis of qualitv has been 
cju: stioned 

When alumni uii .jihmoiuiI diiceii\ concerning the impact ot the 
undergraduate expel n iu i m tin n social arid political beliefs, mo a: i epoi t 
that college had a nsimhIk anl impul isee Heath 19*8 Kuh I97d) When 
t omparc J with tolk t^s ol similar gi rue, certain institutions seem to ha\ c 
J'stmi h.*. impa« Is as e\ idenced h\ alumni s attitudes tow aid soi ial issues, 
i ouimumtv set vice, and benefits ol education (Pac e 1974} Smaller institu- 
tions seem to have somewhat gi eater "impress" capacities { Pace 1979i, thai 
is, alumni i r/ort changing in more profound w avs as a result (c ausal dire 
tion inlei r i) of attending college 

In mosi studies of alumni, relationships between qualitv indicators like 
student abilitv and manifestations like posk ollcge activities have been 
lather weak usiiailv falling shot t ol statistical significant e (see Hov t 196ft) 
for example th< l wi i elation between m*aitutiorial quahtv md inter est in 
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the arts reported by Spaeth and Greeley (1970) was 14 but dropped to 
almost .00 when sex, socioeconomic status, and religion were held constant 
From their own study of alumni and a review of the literature, they con- 
cluded that ' tempts to show that specific institutions have specific effects 

on their students have usually failed It seems to matter less what college 

one attends than that one attend college" (p. 126), 

Checkering (1969) and Bowen (1977) have warned that interpreting ou, 
come results as conclusive evidence of insignificant differences between 
various institutions' impacts may bf misleading. Such conclusions are usu 
ally drawn from aggregated dat*; therefore, the averaging methods used 
tend to obscure rather than illuminate diversity of impact or change among 
students (Feldmaii 1972). Further, involvement factors have not usualiv 
been considered in these analyses. Therefore, attempts on the part of indi- 
vidual institutions to enhance the potential influence of factois thought to 
be related to quality should not be discouraged (Bowen 1977) 

Summary. Persistence has been related to a variety of proxy manifestations 
of qualit> like satisfaction, achievement, and involvement in campus activi- 
ties. Whether students transferor voluntarily withdraw from an institution 
has often been interpreted as a manifestation of poor institutional qualitv 
When student ability is controlled, the majority of institutions have not 
positively influenced achievement. Students' personal development has also 
appeared to be independent of the particular institution attended Post- 
college economic returns have been related to several (some of them 
specious) proxy quality indices Although the lasting influence of college has 
appeared mode* ate across institutions, this finding may be more a product 
of the outcome assessment methods emnloved and variables studied than 
an accurate estimate of the qualitv of ^ie undergraduate experience tor 
individual students. 
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Summary and Conclusions 



Salient Indices of Quality 

Context. Four context indices ma\ be worthwhile indicators of qualm at 
rranv institutions Manv positive indicators and manifestations of quahtv 
have been associated with institutional si/e For example, in smaller institu- 
tions a greater sense of community is often fostered among students, and 
opportunities for assuming leadership positions in cocurricular activities 
like student government and informal contact with faculty tend to increase 
Of course, the size of an institution does not cause these things to happen, 
rather, size encourages their occurrence, 

Clantv of institutional pwrpase has been referred to repeatedly as an 
earmark of a high quality institution Large universities have multiple pur- 
poses and missions to satisfy those competing, diverse audiences that ha\ea 
stake in them (eg, trustees, taxpavers students, alumni) Therefore, such 
institutions rarely are able to project a clear purpose 

Student living environments appear f unctionalK linked to qualm Stu- 
dents spend a disproportionate amount of time during the undergraduate 
vears engaged m nonclassroom activities Therefore, the degree to which 
students are challenged by and satisfied with their living environments is 
worthy of renewed emphasis in the search for qua I it \ 

Forma! svstemic properties such as administrative structures and 
decision-making strategies have not been empirically related to quahtv 
However the informal organization that encourages or hinders facultv 
involvement with students and the extent to which students (eel and act as 
though thev are members of the academic community seems to be a pai tic - 
ularlv promising area of inqmrv 

Input. Although thev have often been used, input indicators have noi been 
powerful predictors of quality manifestations Various inquiries with 
slightlv different foci have been unable to document whether student abilitv , 
t he most often usi d mdic ator of quality, is positively related to the quahtv of 
the experience Perhaps case study portrayals of students vv 1 varying 
levels of ability in institutions with different purposes could hcip fill the 
apparent void in the knowledge about the relationship between student 
ability and quahtv in the undergraduate experience 

Involvement. The degree to w hreh students ai e mvolv ed during the under 
gr ad uate years is one of the most important and perhaps at i ut ate maniit^ 
tations of quahtv Involvement is related to a var lety of other indicator s and 
manifestations often empirically or logicallv associated with quaht v institu- 
tional si7c, general satisfaction with the institution (including satisfaction 
with the living environment and academic pursuits), persistence tocomple 
tion of degree objective, post college community service, and income 

The degree to which facultv expend effort in instruction or involved with 
students out of the classroom has been positively related to many manifes- 
tations of quahtv Identification of the factors related to student and facultv 
involvement (e g , morale, salience of instit utional purpose) seems a promising 
line of inquiry 
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Outcomes. Like institutional si/e, persistence enables students to lake 
adv antage of aval letv of other opportunities related to qualm— for example, 
interaction v\ith f ac ultv and peer s and participation or per haps leadership in 
institutional governing processes Yet persistence ma\ have a pernicious 
influence as well Some students prahablv persist to graduation without 
being encouraged to cnticallv examine their attitudes, values, and behavior, 
which !s more iikelv to be true for the increasing number of part-time 
commuting students 

The search lor increased value resulting horn a college education has 
met with little success Problems associated with aggregation techniques 
and measuring change have often been cited as factors contributing to 
insignificant findings Interestmglv , those few researchers (eg .Cottle I97\ 
Heath 1968. Perr v 1970, White 1966) who have conducted intensive studies 
of small samples of students and alumni have reported provocative 
a*, counts of what happens to students during and after college Like quanti- 
tative assessments of the same phenomena these approadus also have 
limitations, but the insights thev mav pro\ ide (in terms of depth, realization 
of individual potential, etc ) seem to be wouh the limits o{ generalization 
associated with them (see Trow 1975) 

Studies of alumni are thought to be the potentiallv richest source of 
information about college qualitv (Boulding 197S f recdu.an 1<>62, Puce 
Bowen{1979) has suggested that mam important outcomes of col- 
lege cannot be documented at commencement because ihe inip.it ts oi 
changes will not be manifested until some vears later 

/ he residue of atollege edm anon— after f he initial for ge'iin^tif dt lull- -/n 
a vvtual m\^ict\ Moretner ae should be interested \>j the and 
attiliuk s ttfuhtwm, then interests, their t ilia nship their ianuh hie and 
their career < a< tin s< rna* ha\t ^^enaffei ted b\ tin if < allege t \ mru m e* 
fp 2*n 

Quantitative and Qualitative Contributions to Qualitv Assensment 

Qualitv isa niultifacetcdconcepl Alter a studv of theavailablehteiatureon 
qualitv in the undergraduate experience u is easier to understand whv lew 
c tloit^ to describe the multiple properties of qualitv have been mounted and 
^b\ most "qualitv assessment 4 ." relv on quantitative mdi< ators oi qi ahtv 

Without taking into account the purposes ot the institution and tin 
students' personal goals, the degree to which qualitv is present cannot he 
determined Quantitative approaches in particular tend to underestimate 
the ttmendous diversitv that exists within and between institutions of 
higher education In fact, quantitative me. hods often are used to i edui e the 
diversity bv idcntitving the smallest number of variables that seem to 
account lor differences between institutions While the result- of such 
efforts make interesting reading, thev offer little assistance to facultv j id 
staff i espon-ahle /or deter mining and subsequentlv modtf vmg programs m 
enhance qunittv In addition quantitative measures are usuailv insensitive 
to f >stt!v: unintended outcomes and are less like!* than quahtatiw 
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approaches to record the r . lge and depth of affective responses to college 
experience such as disappointment and boredom 

Qualitative assessments are usuallv rich m detail For purposes of mak- 
ing single institutional poll v decisions and momtonng qualm, qualitative 
methods hold great promise, particularly if the reports of persons frequenting 
t he en v ironment are v alued. Nat ui ahstic inquiry strategies tend to be sensi- 
tive to unintended effects and outcomes because facuitv and students are 
encouraged tocandidlv report their experiences in detail, therefore, the data 
collection is not limited to information related to institutional goals 

How ever, qualitative approaches tend to be labor-intensive and tvpicallv 
result in profiles of one or a small number of institutions, programs, or 
students Fot these reasons, researchers have not used them extensively for 
quality assessments acros. many institutions 

Both quantitative and qualitative approaches have limitations Because 
quality is a multidimensional concept, data gathering technques charac- 
teristic of both approaches are required to accurately estimate the degree to 
which quality is present (Solmon 1981) The results from holistic quality 
assessments may be less valid for comparisons across institutions, however, 
thev will be extremely valuable to institutional agents interested in how to 
increase the qualitv of events on their campus 

Conclusions 

The following conclusions seem warranted bv the review of the literature 
pertaining tocommonlv used indicators or manifestations of qualitv in me 
undergraduate experience 

Quaht\ in the undergraduate experience tan he expected undet certain 
conditions 

• Qualitv is mediated by size At a time and in a nation of mass highei 
education, this conclusion — if interpreted as a policy recommendation— 
may seem sophomone Over a decade ago, Chickenng (1969) came to a 
similar conclusion and suggested, as have others, that large institutions be 
subdivided into small, quasi-autonomous learning and living units The 
reorganization o» r administrative structures that were often associated with 
attempts to reduce size may not be necessary, however For example, staff 
on major university campuses have had some success in instilling lovaitv 
and a sense of community within students grouped bv resident unit This 
sense of community scctis to be pat ocularly important in encouraging 
persistence bevond the fir st year or two of college While students are moi e 
hkeiv to he involved in various activities an smaller institutions, the relation 
ship between size and quality may be survilinear and mediated bv other 
variables (eg, degree aii» J kind of student facuitv interaction, institutional 
purpose), that is, below a certain size, curncuiar and personal develop* ent 
opportunities m.iy fall beiow a tolerable level 

• Quality is mediated bv continuity If students remain a»soc ia!ed with the 
college environnent for only an abbreviated period of time, it is unlikelv 
they will benef t from trw liberalizing potential of the college experience 
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Therefore, neither the students' objectives nor the institution's purposes (.an 
be attained However, not all students can be expected toiiur should persist 
through graduation from the original institution Some students' needs and 
personal objectives rnav be better met at another institution or environ- 
ment Therefore, quality ma\ not he adversely affected bv attrition perse If 
however, substantial numbers of st udents or faculty sharing personal goals 
ostensibly consistent with the mstituton's purposes leave the institution, 
quahtv may be threatened In this sense, persistence is more than the pro- 
portion of students ur faculty that return each fall The continuity of panic i- 
pants contnbutes to the support and commitment to attaining the institu- 
tion's and students' purposes, therefore, continuity seems to be a bridging 
variable between size, involvement, and venerativitv 

• Quality is mediated bv involvement _n the part of both students and 
faculty Students who - more involved in both curncular and cocurrn u- 
lar activities seem to benefit more in different ways than their less involved 
counterparts They are happier, are more likely to persist to graduation, and 
exhibit higher levels of achievement and personal development Compar- 
able information on faculty is lavking, although the sociopsvc hological 
tenets that account for students' satisfaction with the institution should also 
generally applv to faculty 

• Quality is enhanced by a generative learning community This conclusion 
is based not so much on the weight of the em pineal evidence as on the clarity 
and cogency of arguments offered by learned observes of higher education 
across decades A generative learning community is characterized bv sup- 
portive, caring people who mix freely with each other in active pursuit of 
ideas, principles, and values (Knefelkamp 1980, Newman 1852) Heath 
(1968) ohserved that the role of faculty was most influential when "thev 
knew both their students and each **her intimately and also when they 
shared an intercommunion (not ju^t intercommunication") with each 
other tp 247) The members of this community willingly share the meaning 
or their experience with others and are committed to ensuring that the next 
generation will benefit from what has been lear ned and endured (Browning 
1973) In sum, a generative learning community maintains links with the 
past present, and future, thereby fulfilling the basu aims of the academy 
preserving, transmitting, and enriching the culture (see Knefelkamp !980 
for a "generatmtv checklist ) 

• Quality isenhamedhv 'quality' of student and faculty effort Facet 1-J80) 
has underscored the importance of the kind a** well as the degree of involve 
ment While time on task (which is conceptually Mmilai to involvement — see 
Astin 1980b) is necessary, it is not sufficient to produce quahtv In other 
words, students must be engaged in an aeiivitv in a vv«?v that contributes 
something to as well as takes something from the experience Faculty also 
manifest quality of effort through their use of instructional strategies Tor 
example, structuring class activities appropriate to the desired learning 
outcomes (see Menges N81 1 consistent with thepuipose(s)of the institution 
and students objectives requires higher le; els of mvolv< merit hum both 
instructors and students 





• Qualitv is a function of a coherent and consistent purpose Chickenng 
(1%9), Heath (\96S\ Keeton (1971, 1974), and manv others have under- 
scored the powerful socializing influence of a salient institutional purpose- 
on students' development of an enlightened and integrated system of 
knowledge, values, and behaviors. Too often overlooked, however, is the 
direction a clear, coherent institutional purpose provides for facultv and 
staff behavior Without purpose, whether faculty make exemplar v or c\ en 
acceptable instructional contributions is difficult to determine The extent 
to which students' learning and personal development goals are in tacit 
agreement with the institutional purpose is probably related to persistence 
and, more importantly, to continuity This tacit agreement is often mani- 
fested bv students as "general satisfaction" with the institution 

Standingalone, no one of these conditions is sufficient evidence of quality tn 
the undergraduate experience Because quality is a multidimensional prop 
ert\. the conditions cited above, with the possible exception of size, are 
required in some degree before quality can be expected Frequent interac- 
tions between and among students and facultv may be the best single index 
of quality, but without purpose, continuity, and generative, such interac- 
tions mav be stripped of their developmental and educative power 

Qualm cannot be directly manipulated b\ certain institutional agents hut 
requires the willing cooperation and commitment of various groups that 
hold a stake in the institution The influence of rationale m institutions of 
higher education supports the belief that students' acquisition of knowledge 
•s a process over which the institution's agents (facultv and staff) ha\e 
considerable control. In the past, the search for indices of quaht* has been 
colored b\ this belief, as evidenced by the reliance on quantita;ive measures 
of context and input variables as indicators of quality In reality, institutions 
have little "control" over how students and facultv behave Certain policies 
and procedures ma\ encourage student and faculty involvement, but, like 
human development, quaht\ cannot be- "programmed ' or even perhaps 
facilitated" (see Perr\ 1981). Oualitv is a product of the interaction of 
c ertain individuals (e g , willing students and compete it, dedicated facul!\ ) 
under certain conditions (eg, in smaller institution:, .*i in academic units 
with salient purposes) 

\eithc quantitative nor qualitative methods of assessment alone are satis 
fai ton- for adequately and act uratelv estimating quality A holistic perspec 
ti\ e on quality assessment that integrates a h >p. ipnate data gathering strate- 
gies from both quantitative and qualitative inquiry paradigms will provide 
the most useful and relevant information for institutional policv makers 
Quality is a b\ -product of the human experience and is therefore subject to 
multiple realities Nothing short of a holistic approach characterized bs 
multiple data source, ^angulation or cross-validation methods, and solicit 
tation of student and facultv reports can be afforded if accurate and useful 
estimates of quaht\ are expected 
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Quantitative context and input variables have not proved particularly 
helpful in estimating quality, largely because thev rarelv have been func- 
tumallv related to manifestations of quality 'institutional size is a notable 
exception) However, few studies exist that focus on what students do with 
institutional resources oi vice versa, i.e.. manifestations resulting from the 
interactions between students and institutional agents and resources Par- 
ticularly lacking are empirical investigations into dimensions of quaiitv 
associated with nontraditional students or learning environments (see 
Harshman !979;Keeton 1974) Therefore, assessorsof quality would do well 
to redirect their energies from reductionistic efforts to identify several 
easily quantifiable variables and to focus instead on the development of 
quaiitv monitoring strategies that are sensitive to the manifestations of 
quality described above Astm (1979 1980b), Bowen (1979), Knefelkamp 
(1980), and Lawrence and Green ( 1980) have offered pithy suggestions for 
institutional policies and procedures consistent with these conclusions 

Quality in the undergraduate experience is not a "mvstenous" concept as 
some wish to believe (see Astm 1980b), and the technology is available to 
estimate the extent to which quality is manifested. The utility of many 
previously identified indicators of quaiitv has been reduced because of the 
lack of a clear definition of quality as an independent variable Therefore, 
the major challenge ahead is to fashion context-relevant definitions of the 
concept t<> guide institutional pohev studies designed to enhance qual'tv 
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